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ABSTRACT ; 

In this report, we describe our implementation of the recursive 
maximum likelihood proportion estimator proposed by I). Kazakos in 
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I. Introduction : 

In this report, we describe our implementation of the 
recursive maximum likelihood proportion estimator proposed by I). 
Kazakos in (l]. Numerical results obtained with this algorithm 
using LANDSAT data are described, and a user's guide for the 
programs as they currently exist on the IBM 360/67 at LARS (ter- 
minal a* lilable at NASA-JSC) is included. 

section 11 contains a description of the algorithm as imple- 
mented. Section III serves as a user's guide to the programs 
available. In section IV, we describe the numerical results we 
have obtained with this algorithm. An appendix contains listings of 
the programs. 


II. The Algorithm : 

Given a set of n- dimensional measurement vectors |x| 
from M normally distributed multivariate pattern classes 
j = l , 2, . . . , M the M-1 dimensional recursive maximum like- 
lihood proportion estimate (RMLPB)^'^ p* at the i^^ data 
vector is given by 

p‘ = P*' ' + 7 L [g (p’" ' . X,) ] 

(f,(Xj) - . f 2 (x,) - f^(x,) . 


M- 1 


(X,) - 


'm< 


X,) 


where 


fj(x) 


is the density function for the 



(1 ) 


class ; 




« 


2 


fj(x) = ( 2 tT )‘"/2 |K^ |‘i exp [(x-up'^K’’(x-u^)] (2) 

where and are the mean and covariance matrix, 

respectively, for the class; g(p*'^, Xj) is the mixture 

distribution estimate, i.e. , 


R(P » ^ 

m - 1 

1 pI'' 

t=\ 

and L is a suitably chosen constant in this approximation. The 

f h 1 

proportion estimate for the M class is denoted by p^^ and 
given by 

m- 1 

Pm = > - I P', 

Jt=l 


In our implementation of this algorithm, we have made 
several modifications to improve its performance. These include 

(1) clipping the value of the update (i.e. second) term in eq. (1); 

(2) renormalizing the p^ at each step so that all p! > 0 and 

m ^ 

X ~ ^ introducing an additional damping term in 

£=1 

the update term of eq. (1), The final form of the algorithm is 


p* = NORM (c, p*"’ + _!_ LMT[T,Lg(p 

^ i -Lm L 


1 


i- 1 


i +n , 


Xi> 




where LMT(a, b) is the clipping function d.-^’ined by 


I 


I 


I 


1 


LMT(a,b) »■ b 

with bj = sign (b^) min (a, I )j 

NORM is the renormalizing function defined by 


where 


NORM(e, y) = the first M-1 elements of y 


m- 1 


y. = ' - I 


i = l 


If 


min (Vj) i ^ > 0 finish else 

y j ^ y j - min (y^) + t i=l,2,...M 


1 
m 

/ I u 

« = l 


and n^ is a positive constant used to damp out early oscillations 
of the estimate. 

Two other algorithms used in conjunction with this one are 
(1) an algorithm to calculate an approxiuiation to L and (2) an 
algorithm to scramble all of the data (the RMLPE uses the 
stochastic approximation, so the data needs to appear in a random 
order). The first algorithm calculates the following approximation 
to L 

L = ( u • min | | •- j 
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where u is the minimum eigenvalue of II with M = 
and 

e" 

k,3 = 1,2,... ,m 

The scrambling algorithm employs a procedure described on page 
125 of [2]. 

III. Program Description and Users Guide 

Three programs have been written to implement this 
algorithm: the proportion estimation program, a program to cal *u- 

late an approximation to L and a program to scramble data prior 
to estimating proportions. These programs are described below 
and listings are provided in the appendix. 

Propcrtion Estimation Program : 

'Ihis program runs on the IBM 360/67 at LABS. Para- 
meters are read from cards describing characteristics of th< 
and the statistics, the processing to be performed, and the desired 
outputs. TTie same data may be processed with several sets of 
statistics. The data is assumed to be sixteen channel data (from 
which any subset of channels may be used) residing on file 1 1 with 
one logical record per data vector. The data may be labelled or 
unlabelled. If labelled, the program will calculate the true propor- 
tions and print out the means of the estimates along with the 
associated variances and mean squared error; if unlabelled, the 
true proportions are read from cards and the same quantities are 
then computed. Due to the use of the stochastic approximation in 

1 

* 

k 


t 


1 


1 


f 


5 


5 


this algorithm, the data vectors * be scrambled before being 

put on file 11. (Program super AM may be used for this 

purpose. ) 

The correspondence between the notation used in the preview 
section and the variables in the program are: 


Above 



no 


T 

L 

G 

fj(x) 

I 

i 

^i 


Program 

Q(J, *) 

ISTRT 

EPS 

TLM 

L 

G 

F (a function subprogram) 
SG 
MU 


Ihe programs are set up to handle up to 16 channel data from 
up to 15 classes with as many as 10 different blocking factors. They 
can treat an unlimited number of data points. The data enters the 
program in "lines" which contain < 15(X) points. 

^ N. B. The total number of points need not be an integral 
multiple of the points per line, 
e. g. if there are 5100 total points, we may 

use NP (the number of points /line = 2(X) 
(the number of lines) > 26 


and 


NL 



additional 
sets of 
statistics 


Figure 1 

Data I>eck Setup for the LANDS AT Version 
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Figure 1 shows the set-up of the data deck necessary to 
execute the program. The input paramet-, rs and their formats are 
described below: 

1) HEDNG - Title to be printed on the output (20A4) 

2) M, MXITER, NK, ISTRT, INQ, CiUTPT, 

L, TLM, EPS, (k(1) . 1=1, NK) 

(4 12, 2 L 1 , 3 G 10.8, 10 X , 10 I 3) 

M - number of classes used 

MXITER - number of sets of statistics to use 

NK - number of blocking factors to use (set » 1) 

ISTRT - starting value of no in eq. (1) 

(defai'.li = ‘^9) 

INQ - = F if the initial guess for the proportion 

estimates (Q's) are to be set = J_ (then 

M 

card set (3) are not used) 

- T if the Q’s are to be read in (card 
set (3) is required) 

0JJTPT - = T if updated Q's are to be printed 

after each line of data. Otherwise set = F 
L - the L value to be used in eq. (1) 

TLM - the maximum permissible absolute value 

for the update quantity for the Q's 
(i.e. 

^ ■ 1 = 1 C(p,.,,x^) 


S 


K ♦ (i- 1 ) + X ) 


1 

i 


1 


I 


I 


I 


I 


EPS 


K(1),I=«1 , NK 


3) CSET 
(16 L 1 ) 


minimum allowable value for a Q during 

-2 

the estimation procedure (10 seems to 
be a good > nolce) 

the blocking factors to be used (set K(I)b1) 

T If 1^^ channel Is to be used 
F otherwise 


CSETj = 


OpMonal 4)((Q(1,J), 1«1, M-1), J=l, Nk) 

(16 G 5. 3) 


The Initial guess for the Q'h . Used only If INQ on 
card 2 Is = T 


5) CL(1), ( MU(J, 1), J=1 . 16 ) 

(26 X, A 1/(5 X, 5 E 15.8) \ 


for I = 1 , 2 , . . . M 


(SC(J,I). ]=I, 1.16) 

(., X, 5 E 15.8) 


These cards contain the statistics for the M classes. 
CL Is the class ID, MU, the mean vector, and 
SG Is the covariance matrix stored In symmetric 
storage mode (1. e. upper triangular part stored by 
columns). Note that there are 33 cards required for 
each class. Additional sets of statistics follow card 
set (7). 

6) NP, NL, 0VTPP, 0UTPX, TRUEP 
(2 1 5, 3 L 1 ) 

NP - numbe»- of points to use per "line” (< 1500) 

NL - maximum number of "lines" of data 
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(I3UTPP - »T the current true proportions are 
printed after each line (used only If 
TRUKP = F) 

= F do not print these proportions 
0UTPX - sT print the data vectors 

a F do not print the data vectors 
TRUEP - = T If the true proportions are to be read 
In (card set (7) Is then required) 

= F the class 1 D Is associated with each 
data vev‘or and the program will calculate 
the true proportions (card set (7) not used). 
Optional 7) (CLS(J), GT(J), J=I,m) 

(S(A 2, G 8.6) ) 

CLS(J) - the class ID for tlie class 

GT(J) - the true proportions for the class 

The data vectors should be on file 11 with 1 data vector per 
logical record In the format 
CL, (X(J), }=], 16) 

(8X, Al, 6X, 16 F 4.0, IX) 

where CL is the class 11) (used only if TRUEP on card 
set 6 = I-) and X(J) contains the 16 dimensional data value 
for a pixel. 

Tlie subroutines used in this program are briefly described below: 

INST AT- reads and prints statistics 
SUBSET- for LANDS AT data (LD) verr'^^n, this 
selects appropriate subsets of the statistics. 
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F 

TP0SE 

GEDATA 


MCHLSK 


computes the value of the density function 
at X 

for the pseudo- random (PR) version, 
transposes the data matrix in situ 
obtains or generates a line of data in the 
required format and order. Also computes 
the true proportions. 

computes the mtxiified Cholesky decomposUlon 
of a covariance matrix stored in symmetric 
storage mcxie. 


Program to Calculate L : 

This program calculates the following approximation to L 

* ('’ • "'j'" 11,1 M 

where h = min eval ( H ) j 

8. I . 

e" 

l(,s,**i,2,..., m 

All notation is as before. 

Input parameters to the program are 
CSET, M, N 

(16L1, 2X, 12, 2X. 12) 

[ N.B. Our (limited) experience with the proportion estimation 

algorithm indicates that a value of 3 for L appears 
optimal despite what this program computes. ] 


1 


I 


I 


■X 




1 1 


Scrambling Program : 

This algorithm scrambles the order of records in a data set and 
creates a new data set. Two storage arrays are used: one containing 

the integers 1 , 2, . . . , N where N is the total number of records 
and the other containing space for one data record. A temporary 
direct access data set, which is the same size as the original data set, 
is used. The algorithm is described below : 

1 ) Set Q j = i for 1 = 1,2 N 

2) Scramble the elements of the vector a . 

(see e. g. ref. (2]). 

3) I-or i = 1 , 2 , . . . , N 

f H 

» Read i*^^ record of original data set 
and store it in vector d. 
b) Write d in a| record in temporary 

data set. 

4) For i = l,2 N 

a) Read i^^ record of temporary data 
set and store u in vector d . 

f h 

b) W rite d on i record t)f new data 

set. 

5) Finished. 

Note that step - i ay not be necessary if one can use the data 
from the temporary direct access data set. 

IV. Numerical Results : 

A variety of numerical experiments were conducted with this 
program to determine its characteristic. Both pseudo- random and 
LANDSAl data were used. 
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f 


i 


« 


12 

The most significant effect of this algorithm is due to the 
scrambling (i.e. the order in which the data is input), if the data 
is not scrambled (i.e. blocks of points from single classes appear to 
the program) unreliable estimates will be produced. Our experience 
with LANl^AT data indicates that the entire data set, whose pro- 
portions are to be estimated, needs to have the individual pixels 
scrambled. Various scramblings will produce different estimates with 
a theoretical variance of L /N where N is the total number of 
pixels. 

Another effect that w'^ noticed was that the variance of the esti- 
mate for the class was always larger than for other classes. 

This asymmetry, we feel, is due to the fact that the algorithm estimates 

f h 

proportions for the first M-1 classes, and the estimate for the M 

M- 1 , 

class is then computed as 1 - ^ p . By reordering the classes 

i = l 

and then ag?'in etfimatlng proportions, it was determined that the 
variance of the class would decrease from 10% to ~ 30%, 

so the effect may not be too harmful. Howe'^er, the user should be 
aware of this and assure that the estimate fr, ^ class is of 

the least interest. 

l^tailed vests of this algorithm were run on some Hill County 
LANDSA'T data in order to compare results with those obtained by 
Coberly and Odell [3| with five other proportion estimation algorithms. 
Table I shows the results obtained from the recursive maximum like- 
lihood estimator ( RMLE) for 26(X) pixels of the labelled data as 
compared to the other five estimators. Note that the RMLE and 
MLE have almost equal variances and mean squared errors. 
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Table II shows the results obtained from the RMLE for 84(X) pixels 
of the unlabclled data. Here again the variances and mean squared 
error .ire approximately the same as those of the MI..E . 

V. Ccncluslons : 

Our experience with this algorithm indicates several important 
factors need be taken account of in using this algorithm: (1) all of 

the data needs to be scrambled point by point, (2) the class of least 
importance should be used as the last class, and (3) a value of ^ 3 
for the parameter L appears close to optimal. 

Our tests indicate that the recursive maximum likelihood esti- 
mator(RMLE) produces results of comparable variance and accuracy 
as the standard maximum likelihood estimator (MLE) of ref. (3). 

The amount of computation involved for the UMI.E is equivalent to 
the first iteration of the MLE plus the scrambling of the data. 
Also, no additional storage is required by this algorithm to store the 
density functions for each data point. 

Further tests of this algorithm with other I^ANI^Al data will 
be necessary to determine the effectiveness of this algorithm in the 
general situation. 
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ummary of Experiment 
(Labeled Data, 2600 Pixels) 
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Table 2 

Summary of Experiment II 
(Total Data Set, 84(X) Pixels) 
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FORTRAN PI 


C 

r. 

r. 

f. 

r 

c 

c 


RFAL Sf;n 36 . 3 (i) .MtM ift, “^n) ,o( ^n, in) , I , x( i A. i vn ) .opt » '• 
1 T ( 30, 10)/30O«>0 ./ 

RFAI.*4 mjM(?700) 

RFAI.*4 A( 30) l(t) 

RrAL*^* osi 30, 1 n) ,oo( 3o, in) / 3riooo , / ,ow( 30, i o) / 3on*o./ 
f.T U5) 

IISF (30* 

HFONG (20) 

S.SS 

K ( 1 (I) , IP 1 ( It)) /io*n/ 

CHAN ( IX* ) 

CL( ) 

I MO, IPNP, INO.nilTPT, FNI) 

CSFT ( IM 

. . FkST/.TRIlF ./ 

/PASS/ sr.,<iii,r,N 
/KSFT/ NSPl.OT 

/GFPTS/ Ml. 

/OROR/ cl 


R»- Al .*4 

RFAL ’fx* 
RFAL"*^ 
RFAL’fH .. 
INTF(.ifk»'. 
IMTFnFP*^ 
IMT‘-(;eR*2 
l.iU* ICAL*! 
Lli(.|CAL»l 
I fU. ir.AL*1 
rnf'K'fiM 
Cl II .fiiir) 
COMMi in 
CO ' HIM 
MAl'FL i ..T 
Mxr Hnal 6 
MXP rs» 1 snn 
*<xr.LSa3o 


/ lOAT/ M, AK, IS r><T , fMO, nilTPT , I , ll.M.FPS, XMX .MX > TFW ,CSFT 


n Ai. 


I«; in HP PR! TFi) 


M - ftlfiRPR IIP CLASSFS DSFI) (.LF.301 
n - MlfOFH OF CHAONFl.S IISFO (.i.P. 1 A ) 

MXITPR - NUMHFK OF TIMFS TO W FOO THF ROM I'TTH OtF-FR 'T OATA 
NK - MIlMHFk OF K'S Tn RF IISFO 

ISTRT - INITIAL V/ALOF OF .1 IM O ( R * i ) =0( R ) - 1 / ( J-i-R ) #1 k 
I h'il - MKtlCAL VARIARLF iNniCATlNf, w.iFTHFR TO RFAO iM 
MIFSS Ftm THF 0*S OR NOT 
OlirPT - Lm.ICAl. WAR »T IF FSHMATF III- O 
AFT PR FACO I. INF OF DATA 
I - THF L VAI.OF IISFO flY THF ALflflRirHO 
TLM - LiniTlNC, VALUF OF L^* A R S ( FJ- FM ) / Cl 
FPS - 1.0WFR LI'IIT ALl.nWFn FOR THF O'S 
XMX - liPPFR LIMIT ALIOWFO FOR THE O'S 
rSFT - ARRAY IMniCATIMG WHICH OF THF lx* 

K - THF HL(lC:<IM(. FACTORS TO R f: DSFO ( .L 
n - THF FSTIMATFS OF THF PRIORS 

S(i - COVAKIAMCF MATRICFS STOrFD in SYM srOWACF MODF 
MU - MFAH WFCTORS 

X - THF OATA vectors FOR 1 ' ' L I A'F ' ' OF OATA 


nvROoni o 
ovRonopo 
nvRonn3o 
ovHoonFo 
ovRonnsfi 
ovRonoAfi 
ovRonoTo 

OVROOORO 

nwRono'xo 
ovKon 1 0(1 
ovRooim 
nvRooi ?o 
ovwoo 130 
hVROOl 40 
nvRno iso 

OWROOlSO 
OVROO 170 
OVROOIRO 
OVROO 1<HI 
nvROopoo 
0VR0021O 
0VR00220 
l|WRO0?3O 
UVR00240 
0VR002SO 
0VR002S0 
HVROO?7I 
OVK002R0 
(|(FFnlO0VKr.02'>O 


( OFF* INF IN IT ' ) 


CHAA'MpLS ARF 
=. m OF THFM 


TO RF 


FACH I.F 


nVR00300 
(IVH00310 

o\/Rno3?o 

OWR 00330 
nwHon'H40 
iivpno 3 so 

flVROOHSO 
nVR 00370 
HSF OOVR0O3RO 


PI 2 = 2 .* 3 .I 41 Sq 2 X,S 
PMOs .FALSF . 


HFAO PARAMFTFKS 


RFAO ( 5 , 1 ) HFONG 

1 FORMAT ( 20 A 4 ) 

WRITF (A. 4 ) HFONC 

4 FORMAT (// 1 X. 20 A 4 ,///) 

RFAO ( 5 ,?) M,MX ITFR ,M< , ISTRT , 1 NO, nilTPT , I , T i. M « P PS , XMX , ( K ( 

2 FORMAT ( 412 , ?L 1 , 4010 . 8 , 1013 ) 

RFAO ( 5 , 3 ) CSFT 

3 FORMA T ( 1 A( 1 ) 

IF (ISTRT .PO.O) HTRT =10 
IF ( TLM.LT .1 .F -2 ) Tl.M=l.F/o 
I'UM-l 
1 TFH =0 

IF ( INO ) on TO 5 
Ofi TO 10 


I ) , 1 = 1 


THFM RFAO IM IMITAAI. OHFSS FOR PRIORS FOR FACH H|_nC<lMO OSFH 


5 

7 


RFAO ( 5 , 7 ) ( (O ( I , J) , I = 1 , Ml ) , J=l, MK ) 

FORMAT ( 1 A 05 . 3 ) 
on TO 20 


FLSF SFT INITIAL OUFSS FOR PRIORS ALL FOIJAI. 


in Y= 1 ./M 

no 15 1=1, Ml 
no 15 J = 1 ,MK 
15 0 ( 1 , J ) = Y 


rvl at p/^ge ® n ) 

'/f 


1 PHVR003O0 
I1VR004 00 
OVR0O41 0 
I1VR004 20 
(IVR0O430 
OVRO044O 
0VR00450 

nvi;oo 4 x*n 
i)VRon47n 
nvhon4R0 
nvRoo4qo 
HVR0050n 
OVROOSIO 

ovwno5 20 

OVRO0530 
l< )nVK0054O 
nvpno55o 
inxRonsAO 
nvRO(i570 
ovkoosho 
HVR0O5HO 
owHoosno 
OVROOAin 
nVROOS 20 
nvRnnx,3n 
nvpo'1540 

nvwooAso 
n\/Roosso 
nvR00A7n 
nVROOS RO 
nv'R00A9n 
nvRoo7on 
ovROOTin 
nvHon7 20 
OVR00730 
ru/Rno74o 
0VR0O750 
OVROOTAO 
nvR0077n 
:(>;c«i{tgcc>!(iti>;ct;i«ll\/Rn07 RO 


I 


FILF, . . OVH FORTRAN PI 


?(\ rOMTINUF 

on 2 b !»l »M) 
nn ?h j»lff'K 
2h ns( I ,j )■<)( I ,.i ) 

WRFTF (6,I0AT> 

TL‘ »Ti.'Vl. 

WRITF ) (K( I J,I«1 ,WK) 

?l FOPMAF (' K«',iniS) 

nn Ib 1 ,mk 

?H WKITF (A.??) I ) 

2? FfiM' AT (• INITIAL 0»',MGI(S.«) 
r Gf-T STATS FfUl THF Cl.ASSFS 

r. 


nvRnn7‘<o 
nvBnoHon 
IIVROOH in 
i»VRnnH?n 
nvRooH in 

DVROOHAO 

nwRnnHsn 
ovpnnHAn 
nvMnoH 70 
O'/RnOHRO 

IWROOHRO 

nvRMoqnn 
n\/('nn') in 
(iwt'onnpn 


r. 

r 

r. 


?n rmiTiMiiF 

TALI. iNSfAT (CSFT, THAN) 

IF (irFM.Hl.(') PI/^-PI^A-flN/? . ) 
nn II ■] ,nk 
3A IP! ( 1 1 )»n 

ni\ r.HnLf-si>Y dfCOmp nF Tmf chvarian'.f*; 


nn /b I » I . I > 

rAii. iiCHLsK (S(.( 1 , 1 ) iNtX,nFT( I n 
?*j nFT ( I I =1 .lift / ( SnWT( OFT ( 1 ) )*Pf 

r 

r fftch n^'F i . inf fif data 

r, 

no r.Ai I. r -nATA ( X ,HP , CHA''j,M,f. mo) 
r 

IF (.OflT.FRST) r,n TO 1 ? 

FRSTa .FALSI'. 


n\/Rno9'An 
(»\/FonqA(i 
nv/RnoRvi 
nvpont^no 
nuRMnR7o 
iiv/wnoyfto 
nvRn(w yo 
nw*. o 1 nnf> 
nw^’oin in 
nwwn 1 n?(t 
i)\/',oin 10 

.y444*<<*<0i<"*><V>Rn 1 OAn 
nv''nio*>n 
t»vpn 1 oAO 
n>/.<f. I0 7(^ 

444tti;i444>.‘>;‘nv^Rn ir>>to 
nwpninoo 
nvRO 1 ion 
nvRn 1 1 10 
nv'Po 1 1 ?(p 


r, 

c 


r. 

r. 

r. 

c 

c 

c 


r. 

r. 

c 


r, 

r. 

r. 


c 

r. 

r. 


i.iinp nvFi? ALL OATA POINTS jo upoatf fstiitatf riF PRin-fs 

17 rONTI II IF 

IFMP= .F/>LSF , 

nn 10 1 = 1 ,iip 

IF n.FO.F'P) leNPa.TRIlF. 

F YIFi.nS TNF VALI": OF THF OFNS I Ty FIInCTIOM FOP THF CI.AS‘ 

fm=f (X ( 1 , 1 ) ,N,sr , ( 1 ,M ) ,Mii( I ,n ) .dft i m) i 

TMF hlXTIlHF niSTRl HOT ION IS SOORFO Pi O 

on 1b II=1,MK 
IS GUI )=FM 

nn AO j = i , 1 1 

FJ=F ( X( 1 ♦ I ) ,11, SGI 1, .1) ,MII( 1 , .)) , OFTIJ) ) 

A(J)=FJ-FM 
AJ=A I J ) 
on Ab 11=1 ,MK 
AS G( I I ) =G I II )+0(J, I I )*A.J 
AO rOMTINIIF 

LllflP TO IIPOATF priors FOR FAf.M HLOOKIMG FaCTUR 

nn bo 1 1 = 1 ,riK 
INn= .FALSI . 

K I=K( I I) 

I'-iKsnoni 1 ,Ki ) 

Gi=(;i 1 1 ) 

IF (HIK .FO.O.OK.l F.I'IP) r,n Tn b? 

GO TO b1 

THFN PP.FPARF TO IIPOATF II-TH PRIORS 

b7 IK = himo( IK,KI ) 

IF (IK.Fn.O) 1K=KI 
INfi= .TKIIF . 

I P 1 ( I I ) = I P 1 ( I 1 ) + I K 

b1 COMTIMIIF pK ,r\'AL page is 

riiMporF iipnATFo sums KJii QUyiUT^ 

(il) 


MVROI l 10 
MY<n 1 lAO 

nwMol I so 
nvKO I inn 
nvROi 170 
lo/pn 1 iHO 

nv/iini ion 

h\/,'0 1 700 

I'VHoii^ in 
rn/pn 1 ??n 
nvRni2in 
OVMO 1 ?An 
nvROi2bo 
nvwo i ?A 0 
nvR0l770 
nwHo 1 ?Rn 
nwKm ?qn 
nwwn 1300 
nvRoi 3 10 
nvwo 1370 
nvKOi 110 
nvwo iiAO 
nuRonbo 
nvwo 11 A 0 
nwRni 370 
nVRO 1 1R0 
OYROl 1RO 
owRo lAon 
nvROiA 1 o 
DVkO lA?n 
nvKOiAio 
DVfWn 1 AAO 

nwROlAbO 
nvwf. lAAO 
nVROlA 70 
OVKO lAbn 
nvRoiAOn 
in/RO 1 bon 
nvwnib 10 

lO/WO 1 b70 
niiROibin 
i)V«0 1 bAO 
O\/R01bb0 
f)WRO IbbO 




p rtP 


nvw 


HIRTRAM PI 


«;-n, 

nn j»i .Ml 

XX»A(J)/f.i 

T(.l, II ) - T ( J , I 1 I ♦MGW( AH IMl ( AHS( XX » , Tl.M) .XX ) 
n- ( iMf> ) <;»i tn SA 
GO Tfl hS 
C 

r, tl|>nATl: TOP PMHIRS AMO PPSCT 

e* 

s*» xx» >(j ,n I )/(iPi( II ) ♦i«;tmt) 

T(.l. I I )«0, 

( J . I I ) ■ X X 
S«S^ XX 
•jS r.riMTlMIlF 

IP I .rl( 1 .iwn ) GO Til so 

r 

r. RPNOKhaL I ^P TOP IIPOATrO PSTMATPS OP THP PH IO«S 

r 

'•(• , 1 1 )■! .mi-s 

S« 0 ( I , I I ) 
nil SA j»?.o 

IP (Cl I.I I) .'.T.SI S-0|.|,II ) 

5 A rniMTiiMih 

ip (S.oT.ppS) i;n m aa 

Ofl s« J «1 ,M 
fM j . 1 1 ) «ou, I I l-s-^PPS 
SH SS»‘^S-H)U , 11 ) 

on A? 

a? o(.i, 1 1 )«ou, I n /ss 

AA COOT 1 1 II Ip 

AO r.llMlIIIHF 

HO rOMTIUllP 

IP ( .•HIT .rillTPT ) GO TO AO 

r 

r, Pui.iT iiiiT opw pstimatp op PHinm; 
r 

1?. no 70 1 I »l ,MK 
S«n , 
nil 7 s 

7 S S»S+(iU , M ) 

0 (H, 1 1 ).] ,nn-s 

70 (A. 7 A) IISPT.KI I I ).(<:•.( .1 ) , 0 ( . 1 , 1 n ,.|= 1 , M) 

Ih PtiHOAT (/• IIPOATPI) pstimatp OF THF PHIOHS POP i. IMP '.IS, 
ir,“IMG FACTOR K=*,n/Al' CLASS*', A?.' n= • , G 1 S . H , HX ) ) 

IP ( .iiitT .pon ) i;n to ao 


OVHO lb70 
nvHOibflO 
owRo ison 
iivpniAOO 
DVROIAIO 
nv-niA?o 
nvHO I A'ifi 
nvHoi AAO 
nv‘*n 1 #,so 
nVHOlAAO 
OVHO IA70 
nwRoisPO 
liWHO 1 AOO 

ii'o' 017 on 

0VH01710 
•)VH0 17?0 

ovwo 1 r-io 
O'/ROl 7A0 
ovwo 1 7SO 
OVR017A0 
nwi^O 17 70 

iivk017 AO 

IIVPO I 700 

nvwoiHoo 
nvpn iM 1 ' 
IiVk-OIH ?o 
nv.io 1 WHO 

OV Jf IRAfi 
ovko I n*,n 
iiWkOI rtAi’ 
hVPO 1 H7'* 
OVROIOkO 
1 1 V W 0 I P " 
ii9twiui;Mii»«uiioin\/K(i ] 0 0(1 
iivi^n loi o 
owHoiopn 
hVWO 1930 
MVHOlVAO 
nv Hi) 149 0 
OV •0 14AO 
nvHO 1 470 
nvwoispio 

OVRO 1 440 
iiURopono 
' w I IH H| Miivwnpoio 
ovM'ny)?o 
I’ iiW(i?(lHO 


r, 

r. OPOATF r.FAMS AOO VARIAMCFS OP THP PSTImaTPS FOW THIS ITP'ATIIA). 

r, 

I Tt-H= ITPU-i-l 
no 1 l A 1 1 *1 ,MK 
nil 119 Ja] ,M 
XX=H( J ,11) 

no( j . 1 1 ) =oR( . 1 , 11 ) -t-xx 

OVI.I, I I )a(iV(.l, I I )-l-XX>!«XX 
119 0( J , I I ) aOS IJ ,11) 

11 A roMiiMiir- 
MSPTaO 
PHI)'- ..-ALSF . 

IP ( I TPH .LT .MX ITP R ) GO TO ?R 
C 

C FIMISHFO WITH ALL DATA, PRINT OUT PSTIMATPS r. STOP 

C 

no 11 M 1I=1,MK 
SlaO. 

no 114 Jal.M 

MSP (.) ) = (OV( J, 1 I )-? .*GT I .1 )*0K( .1 .11 ) ) /MX ITFR + GTI .) )«KGT( .1) 
SlaSl+MSPI.I) 

XXaiiHU.I 1 )/ITFR 
OH ( J , I I ) =XX 
XXaOVI J,I I )/ITFR-XX*XX 
114 nV( J , I I ) aSORT 1 XX ) 

WRITF ( A, 1 31 ) K ( 1 I ) , (CL ( .1 ) ,0H( .1 , 1 I ) ,nV( .1, I I ) .MSF( .1 ) , .1=1 , ') 

131 FORMAT (' Ka'.I'i,' MPANS AND Sn'*S OF THP FSTIMaTFS S TI - MS 6 • / 
1 IA3,(ilA.H,» .GIA.H.GIR .8 ) ) 

SI =S1/M 

WWITF (A,l?l) SI 


I'V/ROPOAO 
iiVHoposn 
I IVRO^'OAO 

nvHn?o 7 o 
nv.^ n;>OHO 
nvwn ?040 
OVWO/l 00 
OVROPllO 
(iVROp I ?0 
OVHO? 130 
nVHO?lAO 
ovwo? ISO 
nvwo? I AO 
nvpo? 170 
nvwo? 1 HO 

OVHO ? 140 

n'/Po??oo 

l)WWO??l O 

nvRo??>o 

nVR0??30 

nvRo?2^o 

nvR 0 ? 29 n 

l)''WO??AO 

l)VH0??70 

nVRO?2R0 

nVRO?290 

nvRo?3oo 

nvRo?3io 

nVR023?0 

OVRO2330 

nVR0?3A0 


(iii) 


ORIGINAL PAGE iS 
OF POOR QUALITY 




/ 

P?LF. . , nVR FORTRAN PI 


llrt rnWTINUF 

1?1 FORMAT (• MFAN M SF • , G I #* . « ) 

STOP 

r. 

r FIMISMFD WITH AU. OATA FOR THIS ITFRATION 

100 FNn-.rPOF, 
r.n TO 7? 

FMO 


nVR0?3S0 
nvR0?3^0 
0VR02370 
0VR023H0 
0VR02390 
nvR 02 ‘i*on 
nVR024 10 
nvpo 24 ?o 

OWW02430 


FMOCTinM ; (X ,N ,L t MO,0FT) 

r. 

r. r.nr poTF i'hf valof of thf ofm«;ity function at x 
c 

RFAL*^ ’ ( n,u n ,Mo( n .v( i(s ) 

PFAL*R TF,S 

c 

c *;oLWF L Y«X-M|) whFRF I IS THF CHliti^SKY OFCOMP of cOVAP aTRIX, 

C niAC. (LFHFNTS of L ARF STORFf) A^ S FC I PP OCA L . 

C 

<;«x (1 )-Mon ) 

VI n»s 

TFnS»S*l. (1 ) 

IF IN.FO.l ) GO TO IS 
K« 1 

r 

C LOOP TO COMRdTh Y ( I ' S ) 

C 

no in ia?,N 

S = X ( I ) -MO ( I ) 

jj* l-l 

no ?n jai ,.i.i 
K = K+ 1 

20 ^ = S-L(K )*Y( J) 

KaK+ 1 

Y( 1 )«S 

TFaTF+S*S«L(K ) 

10 CONTI NOF 
1 S CONT I OOF 

IF (1F.LT.32S.) r ;0 to 17 
FsO. 

RFTORO 

17 F.FXP (Sor,L (-TF/2 . ) )«nFT 
RFTORO 
Fon 


(VM02440 

o\/»»»? 4 Sn 

n\/R024Ao 
|)VW02470 
0VR024Hri 
OVRCPSyO 
nvR02sno 
0VP02S I o 

nv«n?s?o 
nYRfi2S3M 
nvRo?54n 
nvMOPSsn 
l)VRn?5sn 
nvRn?s70 
nvH 02 SHn 
0'/R02590 
i)V‘<02son 
nvR02s 10 

nv«r>2s2o 

OVR02S 30 
OV/H02440 
0VRO2SSO 
0VR02SS0 
OVR02S70 
nvM02s«n 
nvM()?sHo 
nwRo? 7 on 

0VR027 10 
r)VKn?7?n 
0VKO27 30 
nVR027A0 
0VRO27S0 
nwM027so 
0V/R02 7 70 
r)V«r.?7FO 


ORIGINAL PAGE IS 
OF POOR QUAUTYJ 


t 


(iv) 


SKftPtlUT I»'h INSTAT OMAN) 

«f^AL*<* ^f.( 1 ^6. ]40) ,MIM 16, 

IMTPr.*fM «4 r.HAM(I) 

iNTPr.FK*? r.L( lb>,^»c^^>),NP( 16 ) 

Lnr.iCAL*! r.SPT(i6) 
f.nHMKM /PA*;?;/ sr. 
r.UMMItfl /(IKUM/ CL 
on 6 I«1,M 

PFAIt (6,1) r.l. ( t ), (MM (J, )),.!■), 16) 

I FriPMAT ( ?6X, A1 /( 6X,SF 16 .M ) ) 

6 RFAn (6,6) (S(.( J, ( ) ..l«l , I 36) 

6 FORr-AT (6X,6F16,P) 
r.AlL SCRSFT (CSFT , :hAM) 
no [n i«l,'« 

•miTF (6.P) Ci.( I ),M':(I ),MP(I ),«>^ii(.i.n..i-),^) 
p FMMvAT (//' CLASS ' , A?, 16, • Mft , OF PTS«',I6/' .<•/ 

) U.6F11.6) 

WRITF (6,3) 

3 r-IR-AT (• C(IV/»« 1 Af(C6 ' ) 

J 1 * 1 

nn p(\ j«i ,ti 

Pi) wniTF (6,?l) (Sf-C., I ) ,L«J1 , J2» 

P\ FfIRMAT (/(1X,1 3F10.6) ) 

)0 Cf'llTlMIIF 
RFTIIRil 
Fn.i 


nwRfV 

hVKn2HO< 

i< 

fJWRn2H?< 

nvkn?«3r> 

nvR()2R6n 

MWRn2,^sn 

o\/pn2«6f> 

nvpr.2H7r 

f)VRn28R'' 

hvfc»n239f 

n\/R0?9nc 

i'i\/HOP^ 1 

OWB0297P 

tiS/(? 6293( 

Di/pn?^.,* 

|'VH0?96f 

fW<02966 

0wR02'^7M 

liwpo29R'> 

i»wkP?990 

nwwP3«u»o 

l)V/Kn3M?M 

|iWRn3 06M 
I)WI^ (>3066 

(i\/R03n7P 


(CSFT, CHAM) 

LftC If.AL*l CSfT ( 1 ) 

RFAL«f6 S(. (1 36, 30) ,(^ll( 16, 30) 

Ir'TF(,cp#6 CHAi-'ll) 

cn,3 .IIM /i'/,«;s/ sr.,Mii,M,K 

ISO ( J ,.| ).(I#( 1 -1 ) )/2+j 
lMAu( ( ) = ( I*( I + l ) )/2 

F T'O :HA•I^•SLS DFSIKFO 

K xO 

r>ri )o 1 « 1,16 

(F ( .fioT .r.SFT ( 1 ) ) fWi ro lo 

KrK,-! 
r.MAi>' ( < ) X I 
10 CMiiT IMDF 

SFI.FCr APIOOlPt' I ATF S0R6FTS Sr; F. Mil 
J.lsO 

on 20 I »i ,•< 

STO'-F OIA(,OiiAL FLtMFHTS 

.1.1 = JJ+ 1 

Of I Ph L = 1 ,o 

SO(.IJ,l.)xSi,( IOAf;CHAM( I ) ) ,1 ) 

7*1 >MI( ( ,1. )=Mll(CHAfi( I ),U 

IF ( 1 .FO.K ) PETURI'I 


Pf'/F AI.1 F'.FVFMTS (IF MFXT i<rii4 FXCDPl ThF OIAOdMAl. OMt 


L 1 =CHAM( I +1 ) 
on 30 j=i,r 
L7 = CMAf (.1 ) 

.IJ = .IJ+] 
on 30 L = I.i1 

30 SO(.jJ.L )=Sf;( ISR(L1,I.2),I ) 

20 CIH'T f 
STtlp 
p-m 


lO .'I ', iHit 

|0/Pii3(.‘'0 
OURI'^ lor. 

iO'U03 11. 
•i'./. 03 1 ^ 
oW'fiO 1 3 0 

n\/ 

0V/W03 ISO 
I00<03ls0 
OVI o ‘ 170 
l l'.rl 03 1 kio 

(IWIOM 100 
10 /. '03200 
0 \/ 1013 710 
MURi 3220 
i'irpo3 23" 
o\/io<37/,o 
I O/M 03 2sO 
IIVM03260 
ovKO 3 270 
iO/Rr32BC 
OVWO32P0 
l)\/R0330o 
m/ROB ' 1 n 
nvP.o33 7o 
OVR03 330 
0VH0336O 
OVun333|i 
l)VOO3360 
o.WRO 3370 
OVROBB 30 

0\/R033«jfi 

nVR036 00 

fIVRO 36 1 O 
fl''R036 20 
0\/P0 3 63fi 
1WR03660 
■3VR036SO 
n\/W0B6 60 
1VR03670 
1V7034 .30 


original Pagp .« 

oy Poor quality 




->nn or>r» r>r>n 


"X 


i 


SlIRonilT INF r.FDATA ( X , NP , CHIINf if K , • ) 
RFAL*4 Vi( 1 ^A,30).MIM lA, Vl) 

PFAL*4 X (1 A, 1 son ) ,i;t ( 1«) ) 

!NTFGefl*4 r.HAM(l) 
i^'tfgfk*? fL tf l:*( is ) , 

INTFGizM*? LPTSI ISI / IS 
LMf.ICAL*! FPST/.TRMF, 

LftGICAL*! nuTPP.MlITPX 
L'lGFCAL*! TRIIFP 

FOP r.ilUFPLV'S DATA 

/MASS/ SG,MI),v 
rnilMlM /KSFT/ LlMcfGT 
rCr.»“liM /OMOK/ sr.Lf. 
rOM ifiri /(.FPTS/ Ml 

IK I. HOT .MIST) Gil TO lO 
FliS I » .FAI.SF , 

I. 1 1 

K nO 


PTS( IS )/l s*f)/, ITPP/0/,SCLSM S) 
*n/,|PTSn‘>)/iS»n/ 

/ 


_ MiimiIFR IIF MllIf'iTS PFR ''I INK'' I,|F.1Sf,n) 
NL - r'lMRFP IIF LIMFS 

miTMP»T - PRINT RIINNH'G TlIlF MHliPimflUMS 
nilTI>X»7 - PRINT DATA WFCTDRS 
TU|IKM»T - IIFAD IN TRUK PRllPlIMT IMA'S 


OPAII (S,l) MP ,NI. ,'IIITPM .dllTPX . TRIlfcP 
1 FDPMAT (?IS,D. 1) 
wPSbNP 

I'niTK (A.;>) Np ,NI .flllTPP.IIIITPX , rwilFP 
/ FIIP.^AT (' MP«*,IS,' ML“'.IS.' ntlTPM«' ,1 ' IIIITPXa ' ,1 P, • •|'IIFP*», 

1 LP) 

IF (TIIIFM) RF<.D (3,3) (r.i.SU ) ,GT( .1) ,.l«) ,H ) 

3 FliRi AT ( M( A? .C.It.A ) ) 

ID L IMFbI IllF+1 
MPaMpS 

IF (I. I riF ,LF .HU Gil TO ?f> 

FIf'ISHFH "ITH THIS PASS 0^ tmF DATA 

RFHINO n 

ITFP=ITF<+1 

IF ( ITFK .GT .) ) RFTHRM 1 

r.MMMIlTF TRI'F PKOPimTIUHS f, RFARRAMGF CLASSFS TH IHI1S - IM STATS 


5S 

S3 

S? 


sn 


5A 


IF (TIIHFP) 

.IJaO 
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